Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/xmlreport test id #688

Merged
merged 10 commits into from
Jul 28, 2023
Merged

Feature/xmlreport test id #688

merged 10 commits into from
Jul 28, 2023

Conversation

ivan-velasco
Copy link
Contributor

  • For reporting back to a test case matrix, each test case should contain a test case id
    Plan to use the generated .xml and parse the id's to update test case management solution after each CI run
name: TestSuite 

testcases:
  - name: without_id
    steps:
    - type: user_executor
      vars:
        foo:
          from: result.foo

  - name: with_test_id
    id: C1999
    steps:
    - type: user_executor
      foo: "{{.without_id.foo}}"

Report output:

<?xml version="1.0" encoding="utf-8"?>
<testsuites>
  <testsuite name="TestSuite" package="test.yml" tests="2" time="20">
    <testcase classname="test.yml" name="without_id" time="0.1">
      <system-out><![CDATA[
]]></system-out>
      <system-err><![CDATA[
]]></system-err>
    </testcase>
    <testcase classname="test.yml" name="with_test_id" time="22" id="C1999">
      <system-out><![CDATA[

]]></system-out>
      <system-err><![CDATA[

]]></system-err>
    </testcase>
  </testsuite>
</testsuites>

kilianpaquier and others added 7 commits June 21, 2023 17:17
@kilianpaquier @ivan-velasco
feat: removed result from testcase variables and removed errors warni…
ddca825 
…ng and info from non verbose runs (ovh#670)

* feat: remove tc computedInfo, fix info not showing right variable value in teststep and show info before errors
* feat: removed ranged stdout on non-verbose runs
* fix: update failing tests following breaking change
* chore: review README according to latest change

Signed-off-by: kpaquier <[email protected]>
Signed-off-by: Ivan Velasco <[email protected]>
@fokion @ivan-velasco
feat: new assertion ShouldMatchRegex
6ae0170 
Signed-off-by: Fokion Sotiropoulos <[email protected]>
Signed-off-by: Ivan Velasco <[email protected]>
@yesnault @ivan-velasco
feat: improve verbose flag behavior (ovh#675)
01e7a47 
* venom: improve verbose flag behavior

Signed-off-by: Yvonnick Esnault <[email protected]>
Signed-off-by: Ivan Velasco <[email protected]>
@moutyque @ivan-velasco
doc(executor/http): example for a post using a raw body (ovh#677)
1ffe4b4 
Signed-off-by: Quentin MOUTY <[email protected]>
Signed-off-by: Ivan Velasco <[email protected]>
@yesnault @ivan-velasco
fix: prevent err EOF if venomrc is all commented or empty (ovh#678)
7e6e705 
Signed-off-by: Yvonnick Esnault <[email protected]>
Signed-off-by: Ivan Velasco <[email protected]>
@nicolaslacroux @ivan-velasco
docs: updare README.md with 1.1.0 release version of Venom (ovh#679)
ace8048 
Signed-off-by: Nicolas Lacroux <[email protected]>
Co-authored-by: Nicolas Lacroux <[email protected]>
Signed-off-by: Ivan Velasco <[email protected]>
@ivan-velasco
feat: test case id to later use for updating test case management for…
ada56b9 
… reporting purposes

Signed-off-by: Ivan Velasco <[email protected]>
@ovh-cds
Copy link
Collaborator

ovh-cds commented Jul 25, 2023

CDS Report build-venom-a#74.0 ✘

  • Build
    • Build ✔
    • Unit Tests ✔
  • Tests
    • Acceptance Tests ✘

@ovh-cds
Copy link
Collaborator

ovh-cds commented Jul 26, 2023

CDS Report build-venom-a#74.1 ✘

  • Build
    • Build ✔
    • Unit Tests ✔
  • Tests
    • Acceptance Tests ✘

yesnault
yesnault requested changes Jul 28, 2023
View reviewed changes
types.go Outdated Show resolved Hide resolved
types.go Outdated Show resolved Hide resolved
venom_output.go Outdated Show resolved Hide resolved
@yesnault yesnault merged commit 7f81891 into ovh:master Jul 28, 2023
1 check passed
@ivan-velasco ivan-velasco deleted the feature/xmlreport-test-id branch August 1, 2023 19:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yesnault yesnault yesnault approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@ivan-velasco @ovh-cds @yesnault @kilianpaquier @fokion @moutyque @nicolaslacroux